Generating functional analysis of CDMA detection dynamics 

Kazushi Mimura 

Faculty of Information Sciences, Hiroshima City University, Hiroshima 731-3194, Japa^ 

Masato Okada 
Graduate School of Frontier Sciences, 
University of Tokyo, Chiha 277-5861, Japan 
Brain Science Institute, RIKEN, Saitama 351-0198, Japan 
PRESTO, Japan Sciencs and Technology Agency, Chiba 277-8561, Japan 

(Dated: February 2, 2008) 

Abstract 

We investigate the detection dynamics of the parallel interference canceller (PIC) for code- 
division multiple-access (CDMA) multiuser detection, applied to a randomly spread, fully syn- 
cronous base-band uncoded CDMA channel model with additive white Gaussian noise (AWGN) 
under perfect power control in the large-system limit. It is known that the predictions of the 
density evolution (DE) can fairly explain the detection dynamics only in the case where the detec- 
tion dynamics converge. At transients, though, the predictions of DE systematically deviate from 
computer simulation results. Furthermore, when the detection dynamics fail to convergence, the 
deviation of the predictions of DE from the results of numerical experiments becomes large. As an 
alternative, generating functional analysis (GFA) can take into account the effect of the Onsager 
reaction term exactly and does not need the Gaussian assumption of the local field. We present 
GFA to evaluate the detection dynamics of PIC for CDMA multiuser detection. The predictions 
of GFA exhibits good consistency with the computer simulation result for any condition, even if 
the dynamics fail to converge. 
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I. INTRODUCTION 



Mobile communication systems, such as cellular phone systems, are now used every day by 
millions of people worldwide. Code-division multiple-access (CDMA) is a digital modulation 
system that employs spreading codes to enable access to a mobile communication system 



by multiple users Ql- In the multipoint-to-point communication framework, CDMA allows 
several users to share a single communication channel to a base station. Each user first 
modulates one's own information sequence using the spreading code assigned to the user, 
and then the modulated sequence is transmitted to the base station. The base station 
receives a mixture of the transmitted signals and additional channel noise. Using the users' 
spreading codes, a demodulator at the base station extracts the original information sequense 
from the received noise-degraded mixture signal. This process is called a detection. 

Tanaka has evaluated the detection problem by the replica method . However, the 

detection process cannot be treated by the replica method. The detection process of CDMA 
has drawn much attention from theoretical as well as practical viewpoints j^, 0]. Tanaka 
and Okada have applied a dynamical theory of Hopfield model to the detection process 
Their method is equivalent to the density evolution (DE) framework in the field of 
information theory j^. In the DE framework, a local field, which is a matched filter output 
that the estimated parallel interference is subtracted from, is separated into a signal part 
for the detection and a remaining noise part. Furthermore, it is assumed that the noise part 
follows a Gaussian distribution with mean zero. The predictions of DE can fairly explain the 
detection dynamics only in the case where the detection dynamics converge p]. However, 
at transients the predictions of DE systematically deviate from computer simulation results. 
The Gaussian assumption of the local field has a more serious influence, when the detection 
dynamics fail to converge. In such a case, the deviation of the predictions of DE from the 

n 

results of numerical experiments becomes large p]. On the other hand, generating functional 
analysis (CPA) B00Q does not need the Gaussian assumption. In this paper, we 
present GFA to evaluate the detection dynamics for CDMA multiuser detection, applied to a 
randomly spread, fully synchronous base-band uncoded CDMA channel model with additive 
white Gaussian noise (AWGN) under perfect power control. In order to confirm the validity 
of our analysis, we have performed computer simulations for some typical system load and 
channel noise conditions. 
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II. SYSTEM MODEL 



FIG. 1: CDMA communication model. 



We will focus on the basic fully syncronous K-user baseband binary phase-shift-keying 
(BPSK) CDMA channel model with perfect power control as 

1 K 



J2 4bk + (yon^ 



(1) 



k=l 



where is the recieved signal at chip interval /i G {1,---,A^}, and where 6^ ^ 1} 
and G {—1, 1} are the BPSK-modulated information bit and the spreading code of user 
A; G {1, ■ ■ ■ , K} at chip interval /x, respectively. Figure C] shows this CDMA communication 



model. The Gaussian random variable anU^, where 



A^(0, 1), represents channel noise 



whose variance is ctq. The spreading codes are independently generated from the identical 
unbiased distribution = 1) = P{s^ = —1) = 1/2. The factor 1/\/N is introduced in 
order to normalize the power per symbol to 1. Using these normalisations, the signal to 
noise ratio is defined as EB/Nq = 1/ (2o"q). The ratio f3 = K/N is called system load. 

The goal of multiuser detection is to simultaneously infer the information bits bi, - ■ ■ ,bK 
after recieving the base-band signals ■■■,?/ at. The updating rule for the tentative decision 
bk{t) G { — 1,1} of bit signal bk at stage t is 

K 



bk{t) = sgn ( /ifc - Wkk'bk'{t - I] 

k'=l,^k 



(2) 
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where hk is the output of the matched filter for user k: 

1 ^ 

= ^ E ^y", (3) 

and Wkk' is the /cfc'-element of the sample correlation matrix W of the spreading code: 

Wkk' = ^ E 4s'k'- (4) 

The function sgn (x) denotes the sign function taking 1 for x > and -1 for x < 0. This 
iterative detection algorithm is called the parallel interference canceller (PIC) [Ij. As for 
initialization, we assume the matched filter stage, i.e., bk{0) = sgn(/ifc). This initialization 
is easily treated by formally assuming 

&fc(-l)=0, (5) 

for all k. The widely used measure of the performance of a demodulator is the bit error 
rate (BER) Pb{t), which is given by Pb{t) = [1 - m{t)]/2, where m{t) = ^Ef=ibkbk{t) 
is the overlap between the information bits vector b{t) = "''(61, ■ ■ ■ , 6^^) and the tentative 
decision vector b = (bi(t) , ■ ■ ■ ^bxit)) . The operator denotes the transpose. Without loss 
of generality, we assume that the true information bits are all 1, i.e., bk = 1 for all k, because 
the spreading codes are unbiased. 

III. GENERATING FUNCTIONAL ANALYSIS 
A. Generating functional 

We analyse the detection dynamics in the large system limit where K,N 00, while 
the system load jS is kept finite. For generating functional analysis, we introduce inverse 
temperature 7. The stochastic updating rule for the tentative decision bk(t) G {—1, 1} of 
bit signal bk at stage t is given by 

P[bkit + 1) = -bkit)] = ^(1 - tanh76fc(t + l)Mfe(t)), (6) 

where 

K 

uk{t) = hk- Wkk'bk'{t) + ek{t), (7) 

k'=l,^k 
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which is called a local field. In the limit where 7 00, this updating rule is equivalent to 
(12)). The term 6k{t) is a time- dependent external field which is introduced in order to define 
a response function. The inverse temperature and the external field are set 7 — 00 and 
(^k{t) = in the end of analysis. 

To analyse the dection dynamics of the system we define a generating functional Z[ip]: 

Zm = ^ p[6(-l),-.-,b(t)]e-^n.-.&(^)-V'{^) (8) 

where b{s) =^{bi{s), - ■ ■ , bK{s)), ^/'(■s) = ■ ■ ■ , iIjk{s)). In familiar way 

one can obtain from Z[il^] all averages of interest by differenriation, e.g., 

mk{s) = < h{s) >= i lim f^y| , (9) 

Cuk'{s,s') = < h{s)his') >= - lim f f]"^^ , (10) 

d < his) > . dzjip] 

Gkk'is.s) = — - — ; — ^ — = 1 lim - — , ' , — -. (11) 

The dynamics (jHI) is a Markov chain, so the path probability p\h[—l), ■ ■ ■ , b{t)] are simply 
given by products of the individual transiton probabilities p[b(s + of the chain: 

p[6(-i),---,b(t)]=p[6(-i)] n p[ks+i)\mi (12) 



s=-l 

where these transition probabilities are given by 

K -ybk{s + l)Uk{s) 

Since the initial state is given by (j^I), the initial state probability becomes p[b{—l) = 0] = 
Y[f=iP[bki — ^) = 0] = 1. We separate the local field at any stage by inserting a following 
delt a- distributions : 

s=-lfc=l 

where 6u = UlzU ULi and 5u = UlZ-i ULi We can express (jHD as 

6(-i),...,b{t) 
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xe 



X e^s=o Efc=i iT^fe 2 cosh 7Mfc (s- 1)} 



In order to average the generating functional with respect to the disorder {s^} and {n^}, 
we isolate the spreading codes by introducing the variables v^{s),w^{s): 



t-l N 



1 = f6v6v n ne™''('^["''^'^-^^^=i<"'=('^ (16) 

s=-lti=l 
P t-l N 

1 = I 6w6w n ne™"^'^'"''^'^"^^^=^''''^'"''^'^^', (17) 

S = — 1 fJ,= l 

where ^ 0^=1 0*=^ = n;Li 0*=^ = 0^=1 Ui~J., and 5^ ^ 

n^=i nl=^i ^^1^- The term in (fT3j) containing the disorder becomes 



xe~ 


1 Y^iv 

2 Z^,j= 




1 Z^s' = - 


_j/3cr2i)p{s)»;,^(s') 


xe~ 


1 Y^iv 

2 Z^,j= 


Y^t-1 


Y->t-i 

1 2^s'=- 




xe~ 


1 Y^iv 

■ 2 Z^,j= 




1 Z^s' = - 




xe" 


1 Y^JV 

2 Z^,j= 


-1 2^s=- 


1 Z^s' = - 




xe~ 


1 Y^iv 

2 Z^,j= 


-1 2^s=- 


Y^t-i 

1 Z^s' = - 





(18) 

where denotes averaging over the disorder {s^} and {n^}. We separate the relevant 
one-stage and two-stage order parameters by inserting: 

1 = I dqdqe'''^'''-^^'^'-^^^^ (21) 

1 = [^y^'^' I dQdQe'''^'^~-'-^^'s-L,^^^^s^^^^^^^ (22) 
1 = |^E^J^'^^^' j dLdie''^'^--^'^^^^^^ (23) 
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Since the initial state probability is factorisable, the disorder-averaged generating functional 
factorises into single-site contributions. The disorder- averaged generating functional is for 
X — > oo dominated by a saddle-point. We can thus simplify the saddle-point problem to 

in which the functions ^, $, f2 are given by 

t-i 

= i ^ {m,{s)m{s) + k{s)k{s)} 

s=-l 

+^ E E {^(^' ^0 + Qi^, 5')g(s, s') + L{s, s')L{s, s')} (25) 

s=-l s'=0 

1 ^ r r t - 

^ = ^Y.^A E p[6(-l)] / ^M^weS-o^^''^'^"^'"'^"'"^""'''^"^""'^^ 

fe=l h(-^ \ ... h(i\ 



xe 



6(-l),-,fe(*) 

'E!;-iE!ri_i{9(s,s')ks)6{s')+Q{s,s')«(s)«{s')+^(s,s')ks)w(s')} 



xe"^ E~=i El:'_i Elri_i{/3ag^M(3K(«')+«M(^)Q(^.^')*M(«')} 

xe"^ E^=i E!;-i EX'_i{*M(«)[fe(5)--f'(«',5)]*M(5')+'i'M(^)[fc(s')-i(^,5')]*M(s')} 

xe"^ E^=i El=-i El^i-ii"'M(«)[i-"*(«)-"^(«')+9(s.s')]"'M(s')} ^27) 

where 5m = ns=o ^-^^ '^'^ = ns=o ^2^- arrived at a single-site saddle-point 

problem. Using normalization condition and Z[0] = 1, we obtain field derivatives of the 
generating functional as follows: 



< h{s) > =< b{s) (28) 



< bk{s)bk'{s') > = 5k,k' < b{s)b{s') >* +(1 - ^fe.fc') < b{s) >*< b{s') (29) 
d — ^ 

— — — < bk{s) > = -i5k,k' < b{s)u{s') (30) 
where 5k,k' is Kronecker's delta taking 1 ii k — k' and otherwise and < • >* denotes 

^ .,rl ... ES(-l),..,B(t)/<^^^<^^i^({^^i,^})/(A^^,^i}) 

< /(|0, ti, tijj >*= i2_LW _ ^ ^2,1) 

Es(_i),..,6(t) / 5u5uM{{b, u, u}) 

with 

M{{b,u,u}) = p[S(-i)]eELoW«M^-i)-i-2cosh7«{.-i)} 



xe 



The evaluation f\saddie denotes an evaluation of a function / at the dominating saddle point. 
Therefore we see the order parameters are essentially single-site ones. 



B. saddle-point equations 

In the limit K —>■ oo, the integral (j24p will be dominated by the saddle point of the 
extensive exponent + $ + fi. We first calculate the remaining Gaussian integral in Q: 

r dv dw ^i'iw{p-n)v^^''vQv~^''v''Bw-^'iwBv-^''wDw 



n 



(3 J (27r)(*+i)/2 (27r)(*+i)/2 



dv -itvQi;: f,|-i/2 -it-ut(/3-ii__B)£) \p-^l-B)v 
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(3 J (27r)*/' 

= -^(ln|Z)| + ln|g + t(/3-il-S)D"\r'l-S)l), (33) 
where B, D and Q are matrices having matrix elements 

B{s,s') = -ik{s') -G{s,s'), (34) 

2 

D{s, s') = ^ + 1 - mis) - mis') + s'), (35) 

y 

and Qis, s'), respectively. The saddle-point equations are derived by differentiation with re- 
spect to integration variables {m, m, k, k, q, q, Q, Q, L, L}. These equations will involve the 
average single-site correlation C(s, s') and the average single-site response function Gis, s'): 

Cis, s') = lim 1 J2 <bkis)his') > =< bis)bis') >„ (36) 
1 ^ d 



Gis, s') = lim - ^ 7^^T^< ^kis) > = ~i< his)uis') >, . (37) 

Straightforward differentiation by usage of causality, leads us to the following saddle-point 
equations: 

mis) = kis) = qis, s') = Qis, s') = 0, (38) 

kis) = I A, I, (39) 

mis) = < bis) (40) 
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q{s, s') = < b{s)b{s') >,= C{s, s'), (41) 

{—i < b(s)u(s') for s > s' 
0, for s < s', 

Q = -4^1 + f3G)-'D{l + (3^G)-\ (43) 
L = {l-(3^G)-\ (44) 

where Q, L, D and are matrices having matrix elements Q{s, s'), L{s, s'), 

D{s, s') = I3b{s, s') = al + I3[l - m{s) - m{s') + C{s, s')], (45) 

and 

As{s\s")^{ ^ ^ ' ^' ^ (46) 

I 1, for s' = s, 

respectively. Substituting (|HHj) - P^ into (jHH) and introducing a simple rescaling of local 

fields and conjugate local fields, the term < b{s)u >* becomes 

< bis)u >* = J SuSu 6(s)neS--i^^'(^+')"(^)-'"''°^^^"^^^^ 

^^-^'iuRu+iU{u k Tb) 

= ^ / 1 E Ks)R-'v [l + b{s + 1) sgn«(.)], (47) 

in the limit 7 cx), where u = "^(m(-I), ■ ■ ■ ,u{t - 1)), R = (1 + p^G)-^D{l + pG)-^ and 
r = (1 + (3G)~'^(3G. The terms < b{s) >=„ and < b{s)b{s') >* can also be calculated in a 
similar way. 

Let us summarize our calculation. Some macroscopic integration variables are found 
to vanish in the relevant physical saddle-point: m(s) = k{s) = q{s, s') = Q{s, s') = 0. 
The remainig ones can all be expressed in terms of three macroscopic observables, namely 
the overlaps m(s), the single-site correlation functions C{s,s') and the single-site response 
functions G{s,s'). Finally, setting j —>■ 00 and 6{s) = 0, we then arrive at the following 
saddle-point equations in the thermodynamic limit, i.e., K 00: 

m(s) = < b{s) >, (48) 
C{s,s') = <6(s)6(s') >, (49) 

M . < b{s){R-'v){s') >, for s > s' 
G{s,s) = <; (50) 
0, for s < s'. 



The bit error rate is obtained by 



= (51) 



The average over the effective path measure is given by 

r . *-i 1 

<(7(6,'j;)> = JVvTTg{b,v) J] -[I + b{s + 1) sgnu{s)], (52) 



s=-l 

V. . "-7^'". (53) 
'27ri2| 



Tr ^ E > (54) 

6(-i)e{o},S(o),-,fc(t)e{-i,i} 

u{s) = k{s) + v{s) + (rb)(s), (55) 

R = {1 + P^G)-^D{1 + pG)-\ (56) 

r = {1 + I3G)-^I3G, (57) 

Ms) = |A.|, (58) 

D{s, s') = + - m(s) - m(s') + s')], (59) 

\s[s ,s ) = < (60) 
I 1, for s' = s. 

The terms {R^^v)(s) and {Ta)(s) denote the sth element of the vector R~^v and 
Fcr, respectively. Equations ()48|l - (jHn|l entirely describe the dynamics of the system. In the 
limit where t oo, the term (rcr)(s) in ()55p can be regarded as a self-interaction and 
corresponds to the Onsager reaction term in equilibrium statistical mechanics. Therefore, 
in this paper, we call this term the Onsager reaction term. 



IV. RESULTS AND DISCUSSION 



In order to validate the results obtained above, we performed numerical experiments in 
an = 8000 system. Figure El shows the first few stages of the detection dynamics obtained 
from 100 experiments for the cases Eb/No = 7.0, 9.0 [dB], predicted by generating functional 
analysis (GFA) and density evolution (DE) [6], where Eb/No [dB] denotes 10 log;^o -^fe/^o (see 
Appendix Ej). The system load is P = 0.5 < Pc, where Pc is the critical system load defined 
as the minimum system load at which the dynamics fail to convergence. Figure El shows 
the first few stages of the detection dynamics obtained from 100 experiments for the cases 
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Eb/No = 5.5, 7.5 [dB], predicted by GFA and DE with the system load p = 0.7 > Pc- 
Oscillation of the detection dynamics was observed, when jS > (3c- In such a case, both GFA 
and DE predicted the failure of convergence of the dynamics. However, the DE results has 
residual deviations in figures |21 and 121 due to the lack of the Onsager reaction term and the 
assumption that the local field follows a Gaussian distribution. In particular, the deviation 
of the DE predictions from the simulation results becomes large when (3 > (3c- In contrast, 
GFA exhibits good consistency with the simulation results for any system load. 

The difference between DE and GFA appears also in a signal term with respect to the 
information bit of the local field. The signal terms of DE and GFA at stage t represent Bt 
and respectively (see Appendix The signal term k{t) derived by GFA contains all 
response functions s') with s, s' < t- On the other hand, the signal term Bf derived by 
DE contains only the response functions of adjacent stages. This difference appears from 
stage t = 1- The signal term k{l) of GFA is. 



k{l) 



1 PG{0,-1] 

1 

1 1 



/3G(1,0) 
1 



1 - pG{l, 0) + p^G{l, 0)G(0, -1) - pG{l, -1] 



(61) 



while the signal term Bi of DE is 



(3U^ + (3'U,Uo- 



(62) 



As you can easily see, the Bi contains only Ui and Uo, which correspond to G{1,0) and 
^(0, —1) of GFA respectively, while the k{l) has the response function between stage 1 and 
stage -1 as G{1, —1). 



V. CONCLUSIONS 



We presented the generating functional analysis to describe the detection dynamics of 
PIC for CDMA multiuser detection. The predictions of DE can qualitatively explain the 
detection dynamics only when the detection dynamics converge. Furthermore, the deviation 
of the predictions of DE from the results of numerical experiments becomes large when the 
detection dynamics fail to convergence. In contrast, the predictions of GFA are in good 
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FIG. 2: The first few stages of the detection dynamics predicted by generating functional analysis 
(solid line) and density evolution (dashed line). Computer simulations (square) are evaluated with 
N = 8000 from 100 experiments for the cases Eb/No = 7.0 [dB] (upper), 9.0 [dB] (lower). The 
system load is /? = 0.5 < /?c for both cases. 




FIG. 3: The first few stages of the detection dynamics predicted by generating functional analysis 
(solid line) and density evolution (dashed line) . Computer simulations (square) are evaluated with 
N = 8000 from 100 experiments for the cases Eh/No = 5.5 [dB] (upper), 7.5 [dB] (lower). The 
system load is /? = 0.7 > f3c for both cases. 
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agreement with computer simulation result of PIC for any system load and channel noise 
level, even if the dynamics fail to converge. 
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APPENDIX A: DENSITY EVOLUTION OF CDMA DETECTION DYNAMICS 

Density evolution is a useful tool to analyze nonlinear dynamics 0, By means of 
density evolution, the bit error rate Pb(t) of hard decisions bk{t) = sgn [ukit — 1)] at the tth 
stage is given by 

m) = (Ai) 

where Mt are to be evaluated by the following recursive formulas for Bt, Ct.r, Mt, Ut and 
Qty- 

Bt = l-f3UtBt.u (A2) 

Ct,r = Vt,r + l3^UtUrCt-l,r-l 

+ E ^A,. ri (-pu^) + 2 n (-/^^-)' (A3) 

A=-l re=A+l A=-l K=A+1 

Vt,r = <yl + I3{1 -Mt-M, + gi,.), (A4) 
Mt+i = I DzsgniBt + z^t), (A5) 
Ut+i = I Dzz sgn {Bt + z^t), (A6) 



qt+i,T+i = / / DzDuDvsgn{Bt + zJCt,r + uJCt,t-Ct,r 



X sgn {Br + z^Ct,r + v^Ct,t - Ct,r), (A7) 

where Dz = {2T\Y^I'^e-'''' I'^dz. The initializations are V-x,t = Vt-i = a'^+p{l-Mt), 5_i = 1, 
M_i = 0, C_i,_i = + p, C^i^t = Ct,-i = V^i,t - PUtV^i,t-i, and = qt,-i = 0. The 
physical meaning of the parameters Bt, Ct^n Mt, Ut and qt^r is 

Bt = E[uk{t)], (A8) 
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Ct,r = C0Y[Uk{t),Uk{T)], (A9) 

= sgn[Mfe(t)], (AlO) 

k=l 
1 ^ 

Ut+1 = sgn'[Mfc(t)], (All) 

k=l 
1 ^ 

%+i,r+i = — E sgn[Mfc(t)]sgn[Mfc(r)]. (A12) 
fe=i 

n 

The detailed derivation is available in the appendix of the paper '6]. In the derivation by 
means of density evolution, it is assumed that the local field Uk{t) follows the Gaussian 
distribution with mean Bt and covariance Ct^r- Furthermore, the Onsager reaction term is 
ignored. The signal term Bf contains only the response functions of adjacent stages. 
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